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© Display and Image capture apparatus which enables eye contact 



© In a display and image capture apparatus for a 
videophone or video teleconferencing system a half- 
transparent mirror array (20)is disposed adjacent the 
display surface (1A) of a display (1) and a reflected 
image by the half-transparent mirror array is cap- 



FIG. 3 



tured by a video camera (3). The half-transparent 
mirror array is formed by a plurality of micro HMs 
arranged in the same, plane at a predetermined 
inclination angle and reflects incident light from a 
subject toward the video camera. 
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BACKGROUND OF THE INVENTION 

The present Invention relates to a display and 
Image capture apparatus which enables eye con- 
tact between callers In a videophone, video 
teleconferencing or similar system. 

With recent developments of telecommunica- 
tion technology such as video coding techniques, a 
two-way visual telecommunication system which 
links remote places through a video and audio 
communication network, such as a videophone or 
video teleconferencing system, has rapidly come 
into wide use. It is now being expected that the 
two-way visual telecommunication will be able to 
offer images full of a sense of reality by the expan- 
sion of an integrated services digital network 
(ISDN) and broadening of the band of the transmis- 
sion network therefor. Fig. 1 shows a display and 
image capture apparatus which is now employed in 
the two-way visual telecommunication. A video 
camera 3 is mounted on the top or one side of a 
CRT display or like display 1 , the image of a user 
M captured by the video camera 1 is transmitted to 
a similar display and image capture apparatus (not 
shown) at a remote place and displayed on its 
display. In this instance, however, the user M of 
such an apparatus is usually looking at the display 
1 on which the person he is talking to is being 
displayed, and hence he will not turn his gaze on 
the video camera 3. This results in a boresome 
conversation between callers who do not look each 
other in the eyes, although their images can be 
transmitted with a sense of reality. 

Methods which employ a half-transparent mir- 
ror (which may be referred to simply as HM) for 
enabling eye contact between callers are proposed 
in Japanese Patent Application Laid Open Nos. 
269128/87 and 11082/90, for example. Fig. 2 shows 
the basic configuration for such methods. A half- 
transparent mirror 2 is disposed in front of the 
display 1. An image from a subject, i.e. the image 
of the user M is reflected by the half-transparent 
mirror 2 and Is captured by the video camera 3 
disposed above the half-transparent mirror 2. Con- 
sequently, the image thus captured is equivalent to 
an image which is captured from the position of the 
display 1, and since the user's (i.e. talker's) eye is 
being directed toward the display 1 , the eyes of the 
talker M and the listener being displayed on the 
display screen will meet. With such a configuration 
as depicted in Fig. 2, however, the size of the half- 
transparent mirror 2 increases with an increase in 
the size of the display screen of the display 1. This 
will also increase the depth D of the display and 
image capture apparatus, resulting in the apparatus 
inevitably becoming bulky. 

In Japanese Patent Public Application Laid 
Open No. 37890/90 there is proposed, as another 



method for enabling eye contact between callers, a 
configuration in which a mirror or half-transparent 
mirror having a number of parallel slits cut therein 
is disposed aslant in the same fashion as in the 

5 case of Fig. 2, in place of using the continuous 
half-transparent mirror. This is also defective in that 
the overall depth of a combined structure of the 
mirror and the display is large as is the case with 
the prior art example of Fig. 2. In this laid open 

70 application it is further stated that the depth is 
reduced by dividing the slit mirror into two and 
disposed them vertically, but in this case, since 
light reflected by the lower slit mirror enters the 
video camera through the upper slit mirror, a dou- 

75 ble image is captured; hence, this structure is 
impractical. In Japanese Patent Application Laid 
Open No. 209403/91 there is disclosed, with a view 
to reducing the depth of a projection TV set, a 
configuration wherein light from a projector pro- 

20 vided at the lower part in the set is projected to a 
Fresnel mirror mounted on the ceiling of the set 
and the reflected light from the Fresnel mirror is 
projected onto the back of a screen mounted on 
the front of the set. Yet, this laid open patent 

25 application makes no mention of capturing the im- 
age of a person looking at the image on the TV 
display from the direction to meet his eye, and 
even if the Fresnel mirror is replaced for the afore- 
mentioned half-transparent mirror 2 in Fig. 1, the 

30 user M cannot see his image displayed on the 
display, because the Fresnel mirror is not half- 
transparent. 

Thus, the conventional display and image cap- 
ture apparatuses possess the shortcoming that no 
35 eye contact is enabled between callers and the 
apparatuses which enable the eye contact are 
bulky. 

SUMMARY OF THE INVENTION 

40 

It is therefore an object of the present invention 
to provide a display and image capture apparatus 
which is small in size and enables eye contact 
between callers. 

45 The display and image capture apparatus ac- 
cording to the present invention includes: a display 
having a display surface; half-transparent mirror 
means composed of a plurality of micro HMs ar- 
ranged in a plane adjacent the display surface; and 

50 image capture means whereby a subject in front of 
the half-transparent mirror is image captured as an 
image reflected from the half-transparent mirror. 
The micro HMs of the half-transparent mirror 
means are each inclined at a predetermined angle 

55 so that a portion of light incident thereto from the 
direction of the center axis of the display surface is 
reflected at an acute angle thereto. 

With such a construction, the user is allowed to 
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see the displayed image on the display through the 
half-transparent mirror and the video camera is 
capable of capturing the reflected image from the 
half-transparent mirror means as the image of the 
user viewed from the position of the display. Con- 5 
sequently, the eye of the thus image-captured user 
and the eye of the person displayed on the display 
will meet. Moreover, the depth of the entire appara- 
tus can be reduced by a suitable selection of the 
angle of reflection by the half-transparent mirror io 
means to the center axis of the display surface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a side view showing the configuration is 
of a conventional display and image capture 
apparatus which cannot enable eye contact; 
Fig. 2 is a side view showing the configuration 
of a conventional display and image capture 
apparatus which enables eye contact; 20 
Fig. 3 is a side view showing the basic configu- 
ration of an embodiment of the display and 
image capture apparatus according to the 
present invention; 

Fig. 4 is an enlarged side view showing an 25 
example of a half-transparent mirror array 20 for 
use in the embodiment of Fig. 3; 
Fig. 5 is an enlarged side view showing another 
example of the half-transparent mirror array 20 
for use in the Fig. 3 embodiment; 30 
Fig. 6A is a graph showing the relationship be- 
tween the resolution of a reflected image and 
the angle of inclination of a micro HM in the 
case of employing the half-transparent mirror 
array 20 of the structure depicted in Fig. 5; 35 
Fig. 6B is a graph showing measured results of 
the transparency of the half-transparent mirror 
array 20 of the structure depicted in Fig. 5 and 
the contrast ratio of the reflected image; 
Fig. 7A is a diagram schematically showing a 40 
matrix arrangement of micro HMs; 
Fig. 7B is a diagram schematically showing a 
concentric arrangement of micro HMs; 
Fig. 8A is a diagram schematically showing an 
example of the cross-section taken on the line 45 
8-8 in Fig. 7A or 7B; 

Fig. 8B is a diagram schematically showing an- 
other example of the cross-section taken on the 
line 8-8 in Fig. 7A or 7B; 

Fig. 9 is a sectional view showing another exam- 50 
pie of the half-transparent mirror 20; 
Fig. 10 is a side view illustrating an embodiment 
of the display and image capture apparatus em- 
ploying a distortion correcting beam expander 
optical system; 55 
Fig. 11 is a side view illustrating another em- 
bodiment of the display and image capture ap- 
paratus utilizing the distortion correcting beam 



expander optical system; 
Fig. 12A is a photograph of an ITE test chart 
obtained in the case where the beam expander 
optical system was used; 
Fig. 12B is a photograph of an ITE test chart 
obtained when no beam expander optical sys- 
tem was used; 

Fig. 13 is a diagram still another embodiment of 
the display and image capture apparatus ca- 
pable of correcting distortion; 
fig. 14 is a perspective view of a curved mirror 
which is used in the Fig. 13 embodiment for 
correcting elliptic and trapezoidal distortions at 
the same time; 

Rg. 15 is a sectional view for explaining ab- 
normal optical paths in the half-transparent mir- 
ror array; 

Rg. 16A is a graph showing the measured rela- 
tionships between the angular positions where a 
direct reflected image and ghosts appeared and 
their intensities when the angle of inclination of 
the side wall surface of the micro HM was zero 
degree; 

Rg. 16B is a graph showing the measured rela- 
tionships between the angular positions where 
the direct reflected image and the ghosts ap- 
peared and their intensities when the angle of 
inclination of the side wall surface of the micro 
HM was 10 degree; 

Rg. 16C is a graph showing the measured rela- 
tionships between the angular positions where 
the direct reflected image and the ghosts ap- 
peared and their intensities when the angle of 
inclination of the side wall surface of the micro 
HM was 30 degree; 

Fig. 16D is a graph showing the measured rela- 
tionships between the angular positions where 
the direct reflected image and the ghosts ap- 
peared and their intensities when the angle of 
inclination of the side wall surface of the micro 
HM was 50 degree; 

Fig. 17 is a diagram schematically illustrating 
another example of the half-transparent mirror 
array for use in the display and image capture 
apparatus according to the present invention; 
Fig. 18 is a diagram schematically illustrating 
still another example of the half-transparent mir- 
ror array for use in the display and image cap- 
ture apparatus of the present invention; 
Rg. 19 is a diagram showing an example of a 
photograph illustrating a ghost image caused by 
a displayed image; 

Rg. 20 is a side view illustrating an embodiment 
of a configuration for preventing the ghost image 
from appearing; 

Rg. 21 is a side view illustrating another em- 
bodiment of the configuration for preventing the 
ghost image from appearing; 
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Fig, 22 is a side view illustrating still another 
embodiment of the configuration for preventing 
the ghost image from appearing; 
Fig. 23 is a side view illustrating an embodiment 
of a configuration for electrically preventing the 5 
ghost from appearing; 

Fig. 24 is a timing chart for explaining control of 
the display and the video camera in the embodi- 
ment of Fig. 23; 

Fig. 25 is a diagram schematically showing a to 
configuration for controlling a back light in the 
case of employing a liquid crystal display in the 
Fig. 23 embodiment; 

Fig. 26 is a diagram schematically showing a 
configuration for controlling an image display in 75 
the case of employing the liquid crystal display 
in the Fig. 23 embodiment; 
Fig. 27 is a diagram showing a configuration for 
controlling a shutter disposed in front of the 
back light in the case of employing the liquid 20 
crystal display in the Fig. 23 embodiment; 
Fig. 28 is a diagram schematically showing a 
configuration for controlling a display driver in 
the case of employing an emissive display in 
the Fig. 23 embodiment; 25 
Fig. 29 is a sectional view showing the structure 
of a two-direction reflecting half-transparent mir- 
ror array for use in the display and image cap- 
ture apparatus of the present invention; 
Fig. 30 is a side view illustrating an example of 30 
the configuration of the display and image cap- 
ture apparatus utilizing the half-transparent mir- 
ror array depicted in Fig. 29; 
Fig. 31 is a plan view illustrating another exam- 
ple of the configuration of the display and image 35 
capture apparatus employing the half-transpar- 
ent mirror array depicted in Fig. 29; 
Fig. 32 is a diagram for explaining how two 
captured images obtained with the configuration 
of Fig. 31 are superimposed one on the other to 40 
form a synthesized image; 
Fig. 33 is a front view showing a portion of a 
half-transparent mirror array which reflects light 
in four directions; 

Fig. 34 is a plan view showing the configuration 45 
of a display and image capture apparatus which 
provides a 3D display; 

Fig. 35 is a side view for explaining the principle 
of operation in the case of using a polarizing 
beam splitter as the micro HM; 50 
Fig. 36 is a side view illustrating the configura- 
tion of a display and image capture apparatus 
employing the half-transparent mirror array 20 
formed by an array of micro beam splitters 21 ; 
Fig. 37 is a sectional view illustrating the con- 55 
struction of a display panel in the case where 
the half-transparent mirror array 20 composed of 
the micro beam splitters is used both as a color 



filter and as a polarizer of a color liquid crystal 
display; 

Fig. 38A is a front view of another half-transpar- 
ent mirror array for use in the present invention; 
Fig. 38B is a sectional view taken on the line 
38B-38B in Fig. 38A; and 
Figs. 39A through 39C are schematic diagrams 
for explaining first to third steps involved in the 
manufacture of the half-transparent mirror array 
depicted in Figs. 38A and 38B. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENT 

Fig. 3 illustrates an embodiment of the display 
and image capture apparatus according to the 
present invention. A substantially rectangular half- 
transparent mirror array 20 is disposed adjacent 
the front of a display surface 1A of the display 1. 
The video camera 3 is disposed at a position 
diagonally above to the front of the half-transparent 
mirror array 20, outside the visual angle of the user 
M to the display surface 1A, the video camera 3 
being directed substantially to the center of the 
half-transparent mirror array 20. As described later, 
the half-transparent mirror array 20 is formed by a 
plurality of micro HMs arranged in the same plane 
with each of their mirror surfaces directed to a 
predetermined position. Incident light I from the 
subject M, parallel to an optical axis Ox perpen- 
dicular to the half-transparent mirror array 20. is 
reflected by the mirror array 20 to the direction of a 
certain reflection angle \p and the reflected image is 
captured by the video camera 3. Thus the video 
camera 3 is capable of capturing the image of the 
talker M from the direction which coincides with his 
eye. Since the half-transparent mirror array 20 can 
be disposed in parallel to the display surface 1A of 
the display 1 unlike in the prior art example of Fig. 
2, the depth D can be appreciably reduced as 
compared with that in the case of Fig. 2 and the 
apparatus can be reduced in size accordingly. By 
setting the direction of reflection of light as desired 
by suitably selecting the azimuth of the reflecting 
surface of each micro HM forming the half-trans- 
parent mirror array 20, the video camera 3 can be 
disposed below or on the right or left side of the 
display 1. The half-transparent mirror array 20 
need not always be disposed in parallel to the 
display surface 1A but may also be tilted at a small 
angle to some extent. Moreover, as will be de- 
scribed later in respect of other embodiments 
(Figs. 11 and 13), it is also possible to employ a 
configuration in which a reflecting mirror is placed 
at the position of the video camera 3 in Fig. 3 and 
the video camera 3 is mounted on the display 1 or 
disposed beside or under the display 1. 

Fig. 4 illustrates in section an embodiment of 
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the half-transparent mirror array 20 for use in the 
display and image capture apparatus according to 
the present invention depicted in Fig. 3. The hal- 
ftransparent mirror array 20 is formed by a plurality 
of strip-like micro HMs 21 which have a length 
substantially equal to or larger than the width of the 
display surface 1A and are arranged in parallel in 
the same plane with spacings d so that they extend 
horizontally. The angle 0 in Fig. 4 is the angle of 
inclination of each micro HM (i.e. the inclination of 
its mirror surface). With such a structure, a portion 
of incident light in the direction of the optical axis 
Ox is reflected to a direction of the angle ^ = 20 
as shown. The width W of each micro HM 21 can 
be selected to be about the same size as a picture 
element. The micro HMs are not limited specifically 
to the strip-like ones but may also square and ring- 
shaped ones as will be referred to later one and 
they may also be arranged in a matrix or concen- 
tric form. 

Fig. 5 illustrates another embodiment of the 
half-transparent mirror array 20 for use in the 
present invention. In this embodiment the half- 
transparent mirror array 20 is produced by machin- 
ing or molding one surface of a transparent sub- 
strate 22 as of glass or synthetic resin so that 
ridges 21 W each having a slope of the inclination 
angle 0 and the width W are arranged in parallel 
over the entire area of the substrate surface, fol- 
lowed by coating the micro HMs 21 on the slopes 
of the ridges 21 W to form the plurality of strip-like 
micro HMs 21 as a unitary structure with one 
another, the side wall surface 21 S of each ridge 
21W is inclined at an angle <t> to the optical axis 
Ox, by which is defined the spacing d which is 
determined by d = Wsin0tan<fr. In this embodiment 
no micro HM is formed on the side wall surface 
21 S. The pitch P of the ridges 21 W on which the 
micro HMs 21 are formed may preferably be small, 
from the viewpoint of averaging the influence on 
the image displayed on the display screen 1A; for 
example, the pitch P is selected in the range of 0.1 
to 2 mm when the diagonal of the display surface 
1A is about 10 inches. The width W and/or spacing 
d of the micro HMs 21 need not always be held 
constant and at least one of them may preferably 
be varied randomly so as to prevent the formation 
of moire fringes by the interaction with the pixel 
arrangement on the display surface 1A. The half- 
transparent mirror array 20 having the micro HMs 
21 formed as a unitary structure, as mentioned 
above, eliminates the necessity of positioning the 
individual micro HMs 21 unlike in the Fig. 4 em- 
bodiment, and hence it is easy to fabricate. 

As is evident from Fig. 5, when the angle 0 is 
45 degrees, the angle ^ is 90 degrees and the 
reflected light by each micro HM 21 travels right 
upwardly. That is, the reflected light strikes against 



the adjoining micro HM 21 and does not reach the 
video camera 3. Hence, at least the angle 0 needs 
to be less than 45 degrees. On the other hand, in 
the case where the video camera 3 in the Fig. 3 

5 embodiment (or a mirror 10 or 11 in Fig. 11 or 13) 
is disposed outside but adjacent an area onto 
which the area of the display surface 1A is projec- 
ted forwardly in parallel thereto and the optical axis 
of the video camera 3 is directed toward substan- 

10 tially the center of the display surface 1A, the 
distance D from the half-transparent mirror array 20 
to the video camera 3 (or the mirror 10 or 11) is 
expressed by D = Htan(9O 0 - 20)/2, where H is 
the height of the display surface 1A. Accordingly, 

75 the depth D can be made smaller than in the case 
of Fig. 2, by selecting the inclination angle 6 of the 
micro HM in Figs. 4 and 5 to be larger than 13 
degrees. 

In the case where such a half-transparent mir- 

20 ror array 20 as depicted in Fig. 5 is placed in front 
of the display surface 1A in Fig. 3, the caller M can 
see the displayed image on the display surface 1A 
through the micro HMs 21 of the half-transparent 
mirror array 20 and the intermediate portions sepa- 

25 rating them at intervals d, whereas the image of the 
caller M can be captured by the reflected light from 
the micro HMs 21. By raising the reflectivity of the 
micro HM 21 to increase the brightness of the 
image captured by the video camera 3, the bright- 

30 ness on the display surface 1A viewed from the 
caller M decreases, but by increasing the spacing 
d, the quantity of light reaching the caller M 
through the intermediate portions d from the dis- 
play surface 1A increases, enhancing the bright- 

35 ness on the display surface 1A. The same is true 
of the half-transparent mirror array 20 shown in Fig. 
4. Incidentally, the half-transparent mirror array 20 
in Fig. 5 is shown to be disposed in front of the 
display surface 1A with the micro HMs 21 facing 

40 toward the caller M, but they may also face toward 
the display surface 1A. 

Fig. 6A shows the relationship between the 
resolution of a reflected image and the inclination 
angle 0 of the micro HM 21 when the half-transpar- 

45 ent mirror array 20 of the Fig. 5 embodiment was 
used. The pitch P of the micro HMs 21 was 0.9 
mm. The resolution was evaluated in terms of 
horizontal resolution of the reflected image cap- 
tured by the video camera 3. The resolution in the 

60 case of the angle 6 = 0 is the resolution of an 
image captured directly by the camera. As will be 
seen from the graph, the resolution lowered with an 
increase in the angle 0, and when the angle was 40 
degrees, the image quality was impaired so badly 

55 that it could not be evaluated. It is therefore desir- 
able, in the half-transparent mirror arrays 20 of 
such structures as depicted in Figs. 4 and 5, that 
the angle 0 be smaller than 40 degrees in practice. 
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Fig. 6B shows the relationship between the 
transparency of light through the half-transparent 
mirror array 20 of Fig. 5 and the contrast ratio of a 
reflected image from the mirror array. Six half- 
transparent mirror arrays 20 of different transpar- 
encies were each produced by forming the ridges 
21 W each having a slope of the inclination angle 6 
= 25 # at the pitch P = 0.9 mm all over the 
surface of the transparent substrate 22 made of 
acrylic resin and then vapor-depositing a metallic 
film on the slope. The sample of a 80% transpar- 
ency had no metallic film. The contrast ratio was 
obtained in such a manner as mentioned below. In 
the configuration shown in Fig. 3 a liquid crystal 
display was used as the display 1, a reflected 
image of a monochrome test pattern by each half- 
transparent mirror array 20 was captured by the 
video camera 30, the thus captured image was 
displayed on the liquid crystal display 1 and the 
brightness of each of black and white areas of the 
monochrome test pattern thus displayed was mea- 
sured through the half-transparent mirror array 20, 
whereby the contrast ratio was evaluated. As 
shown in Rg. 6B, when the transparency is above 
50%, the contrast ratio is below 5 and the image 
quality of the displayed image is impaired. Hence it 
is preferable that the transparency of the half- 
transparent mirror array 20 be below 50%. 

Figs. 7A and 7B each show an example of the 
arrangement of the micro HMs 21 of the half- 
transparent mirror array 20 for use in the apparatus 
depicted in Rg. 3. In the case of Fig. 7A rectangu- 
lar micro HMs 21 are arranged in a matrix form to 
form the half-transparent mirror array 20, and in 
this instance, by irregularly varying the pitch of the 
arrangement of the micro HMs 21 and/or their 
sizes, it is possible to prevent the formation of 
moire fringes which would otherwise be caused by 
the interaction between the arrangement of the 
micro HMs 21 and the pixel arrangement of the 
display 1. In the case of Rg. 7B arc-shaped micro 
HMs 21 each have a surface inclined with respect 
to the center C common to them and a number of 
such micro HMs 21 of different radii are arranged 
concentrically to form the surface configuration of 
what is called a Fresnel lens. 

Rgs. 8A and 8B are enlarged sectional views 
taken on the lines 8-8 in Rgs. 7A and 7B, respec- 
tively, illustrating examples in which the inclination 
angle 6 of the micro HMs 21 are gradually varied in 
the direction of their arrangement. In Rg. 8A the 
inclination angle e varies so that the reflecting 
surfaces of the micro HMs 21 sequentially vary 
counterclockwise as the uppermost micro HM 21 is 
approached. When arranged in such a matrix form 
as shown in Rg. 7A, the micro HMs 21 of this 
structure form a Fresnel mirror equivalent to a 
cylindrical concave mirror, by which the reflected 



image can be enlarged in a direction perpendicular 
to the axis of the cylinder. When applied to the 
case of Rg. 7B, the micro HMs 21 form a Fresnel 
mirror equivalent to a concave mirror. In this in- 

5 stance, the image of a subject is enlarged (i.e. the 
angle of visibility is reduced). Fig. 8B shows an 
example in which the reflecting surfaces of the 
micro HMs 21 sequentially vary clockwise as the 
uppermost micro HM 21 is approached. The micro 

70 HMs 21 of such sequentially varying inclination 
angles, when arranged in the matrix form as shown 
in Rg. 7A, form a Fresnel mirror equivalent to a 
cylindrical convex mirror, by which the reflected 
image is compressed in a direction perpendicular 

75 to the axis of the cylinder. When arranged in such 
a concentric form as depicted in Rg. 7B, they form 
a Fresnel mirror equivalent to a convex mirror, and 
hence widen the angle of visibility of the video 
camera 3. 

20 Needless to say, the present invention is ap- 
plicable not only to a display and image capture 
apparatus employing a CRT but also to ap- 
paratuses of the type utilizing a flat panel display 
such as a liquid crystal display. 

25 With the half-transparent mirror array structure 
shown in Rg. 5, the ridges 21 W each act as a 
prism on light transmitting therethrough. In other 
words, the optical path of light incident on the half- 
transparent mirror array 20 is bent. As a result, 

30 viewing of the display surface 1A from the front 
thereof through the half-transparent mirror array 20 
is equivalent to directly viewing of the display sur- 
face 1A diagonally at a certain angle to the optical 
axis Ox. The direction of this inclination differs 

35 depending on whether the display surface 1A is 
viewed through the afore-mentioned micro HMs 21 
or the intermediate portions d. In the case of view- 
ing the displayed image, the optimum direction of 
the line of sight depends on which of the light rays 

40 through the micro HMs 21 and the intermediate 
portions predominantly contributes to the bright- 
ness of the image being observed. On the other 
hand, in the case of using a liquid crystal display 
as the display 1, the image "quality is badly im- 

45 paired unless the liquid crystal display is viewed 
from the direction in which the contrast ratio is 
high, because the contrast by the liquid crystal 
display is usually dependent on the viewing direc- 
tion. Hence it is preferable that the optimum line-of- 

50 direction in which the optical path was bent by the 
half-transparent mirror array 20 and the optimum 
direction of visibility of the liquid crystal display 
coincide with each other. For instance, in the case 
where incident light is reflected by the half-trans- 

55 parent mirror array 20 diagonally upward as shown 
in Fig. 3 and the quantity of light from the dis- 
played image through the intermediate portions d 
is predominant for the brightness of the image, 
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provision is made for making the optimum direction 
of visibility of the liquid crystal display diagonally 
downward. Conversely, in the configuration of the 
apparatus in which the incident light is reflected 
obliquely downward, the half-transparent mirror ar- 
ray 20 is adapted to reflect incident light obliquely 
downward and the optimum direction of visibility of 
the liquid crystal display is selected to be obliquely 
upward. 

In the half = transparent mirror array 20 of Fig. 
5, gaps between adjoining ridges 21 W may be 
filled with a transparent resin 21 G so that the array 
surface becomes substantially flat, as shown in Fig. 
9. This permits protection of the micro HMs 21 and 
allows ease in cleaning the surface of the half- 
transparent mirror array 20. Moreover, the transpar- 
ent resin portions 21 G each act as a prism for light 
reflected by the micro HM 21 , with the result that 
an angle f of the reflected light emitted from the 
resin portion 21 G with respect to the optical axis 
Ox is greater than the reflection angle t£. Hence, in 
the case where the video camera 3 is disposed in 
the direction of the same angle as that the half- 
transparent mirror array 20 shown in Fig. 9 affords 
further reduction of the inclination angle 6 of the 
micro HM 21, facilitating the fabrication of the half- 
transparent mirror array 20 accordingly. When the 
refractive index of the transparent substrate 22 and 
the refractive index of the resin portion 21 G are 
substantially equal, each resin portion 21 G and 
each ridge 21 W do not act as a prism for light 
passing therethrough and the line of sight to the 
display surface 1A from the front thereof is not 
bent. Also in the half-transparent mirror arrays 20 
shown in section in Figs. 8A and 8B the gaps 
between the ridges 21 W may similarly be filled 
with the transparent resin 21 G. 

Incidentally, in the case where such a strip-like 
half-transparent mirror array 20 as shown in Fig. 4 
or 5 is used in the apparatus of Fig. 3, the sectional 
configuration of a reflected light beam correspond- 
ing to a circularly-sectioned incident light beam 
remains unchanged in the horizontal direction but 
is compressed cos^ = cos20 times, and hence 
becomes elliptic. Accordingly, the image of the 
caller M captured by the video camera 3 in such 
an optical system is also compressed in the verti- 
cal direction and hence gets distorted. The distor- 
tion increases with an increase in the angle 0. 
Furthermore, since a mirror image by such a half- 
transparent mirror array 20 inclines forwardly, a 
trapezoidal distortion is introduced in the image 
formed on the video camera 3 (for example, the 
head of the caller M is enlarged and his leg portion 
reduced) and the distortion also increases with an 
increase in the angle 0. 

Fig. 10 schematically illustrates the configura- 
tion of an embodiment of the display and image 



capture apparatus of the present invention which is 
designed to correct the above-noted distortion of 
an image. The reflected image from the half-trans- 
parent mirror array 20 is captured by the video 

5 camera 3 after passing through a beam expander 
optical system 7 comprised of a cylindrical con- 
cave lens 8 and a cylindrical convex lens 9. the 
beam expander optical system 7 is to enlarge or 
reduce the reflected image in a direction in which 

w the distortion of the image in the vertical direction 
is corrected by the cylindrical lenses 8 and 9, and 
the reflected image compressed by the half-trans- 
parent mirror array 20 is enlarged conversely, by 
which the distortion of the image can be corrected. 

75 Since the enlargement ratio or reduction ratio of 
the reflected image depends on the focal lengths of 
the cylindrical lenses 8 and 9 and the distance x 
therebetween, the trapezoidal distortion of the re- 
flected image can also be corrected by setting the 

20 focal lengths and the distance x within certain 
limits. 

Rg. 11 schematically illustrates the configura- 
tion of another embodiment of the display and 
image capture apparatus provided with the optical 

25 system for correcting a distortion of an image. The 
reflected image from the half-transparent mirror 
array 20 is reflected substantially horizontally by a 
mirror 10 disposed at the position of the beam 
expander optical system 7 in Fig. 10 and the 

30 reflected image from the total reflection mirror 10 is 
captured by the video camera 3 mounted on the 
display 1. In Fig. 10 the reflected image from the 
half-transparent mirror array 20 is captured by the 
video camera 3 and hence is reversed, but in the 

35 embodiment of Fig. 1 1 the image is reflected twice 
by the half-transparent mirror array 20 and the total 
reflection mirror 10, and hence is not reversed. 

Figs. 12A and 12B shows the results of image- 
capturing experiments on the apparatus of Fig. 11 

40 configuration in the cases where the beam ex- 
pander optical system 7 was used and not used. 
The subjects used are ITE test charts, which reveal 
that when no beam expander optical system is 
used, a circle is distorted vertically and hence is 

45 elliptic as shown in Rg. 12B but that when the 
beam expander optical system is used, a circle is 
obtained as shown in Fig. 12A. 

Rg. 13 schematically illustrates still another 
embodiment of the display and image capture ap- 

50 paratus designed to correct a distortion of an im- 
age. This embodiment does not employ the cylin- 
drical lenses 8 and 9 and substitutes the total 
reflection mirror 10 with a curved mirror 11. The 
micro HMs 21 of the half-transparent mirror array 

55 20 are constructed so that an image is reflected 
therefrom diagonally upward, and the reflected im- 
age is reflected by the curved mirror 11 placed 
diagonally above the half-transparent mirror array 
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20, thereafter being captured by the video camera 
3 mounted on the display 1. The reflected image 
from the half-transparent mirror array 20 is com- 
pressed in the vertical direction. In this embodi- 
ment, however, a cylindrical convex mirror is used 
as the curved mirror 11 and is disposed so that the 
axis of its cylindrical configuration is in the plane of 
the paper of the drawing (in a vertical plane viewed 
from the caller M) and the reflected image is com- 
pressed in the horizontal direction to about the 
same extent as in the vertical direction, whereby 
the distorted image can be corrected. The curved 
mirror 1 1 used herein possesses a combined func- 
tion of a cylindrical lens and a mirror. Moreover, 
since the enlargement and reduction ratios of the 
reflected image by the curved mirror 1 1 depend on 
its curvature, it is also possible to correct the 
trapezoidal distortion by distributing the curvature 
of the mirror 1 1 to some extent so that its radius of 
curvature is, for example, small at the top and large 
at the bottom, as shown in an exaggerated per- 
spective view in Fig. 14. In addition, since a simple 
optical system including the curved mirror 1 1 alone 
is employed as a substitute for the beam expander 
optical systems 7 described above in respect of 
Figs. 10 and 11, the display and image capture 
apparatus of this embodiment is small and low- 
cost. 

While in the above the cylindrical convex mir- 
ror is employed, it is a matter of course that the 
elliptic distortion can be corrected even by enlarg- 
ing the reflected image from the half-transparent 
mirror array 20 in the vertical direction through use 
of a cylindrical concave mirror disposed so that its 
axis may be horizontal, as described previously in 
connection with the combination of the structures 
of Figs. 7A and 8A. 

In the case where the spacing d of the micro 
HMs 21 of the half-transparent mirror array 20 
shown in Fig. 5 is selected small, for example, 
zero, an abnormal path such as indicated by h in 
Fig. 15 is formed along which light reflected by the 
micro HM 21 is incident on the side wall 21 S of the 
adjoining ridge 21W, then totally reflected by, for 
example, the back of the micro HM 21 formed on 
that adjoining ridge 21 W (all points of total reflec- 
tion being indicated by small white circles), further 
reflected by the back of the substrate 22 and one 
portion of the thus reflected light is emitted from 
the half-transparent mirror array 20 to the video 
camera 30. As a result, a ghost image is formed 
along with a normal image (i.e. a directly reflected 
image) which is formed by light having reached the 
video camera 3 via such a normal path as indicated 
by a ray fe. Similarly, a ray b incident directly on 
the side wall surface 21 S of the ridge 21 W may 
also cause such a ghost image. There is the pos- 
sibility that various ghost images are formed by 



various stray rays other than the directly reflected 
rays, but it is very difficult theoretically to predict 
them. Then it is desirable to prevent from causing 
that light coming along the optical axis Ox from the 

5 subject M standing in front of the display 1 is 
reflected by the micro HM 21 to enter the side wall 
21S of the adjoining ridge 21 W as in the case of 
the ray h. One effective method therefor is to 
provide the intermediate portions d between the 

70 micro HMs 21 as depicted in Fig. 5. In the example 
of Fig. 5 the adjoining micro HMs 21 are spaced 
apart by forming the side wall 21 S of the ridge 
21 W at the angle <J> to the optical axis Ox. If the 
angle <f> is selected equal to or larger than the 

75 reflection angle, ^ = 20, of incident light parallel to 
the optical axis Ox and reflected by the micro HM 
21, the reflected light will not enter the side wall 
21S of the adjoining ridge 21 W. In other words, it is 
desirable to select the spacing d or the angle 4> 

20 such that d = Wsine # tantf> 2, Wsin0Man2e. For 
example, in the case where the inclination angle 6 
of the micro HM 21 was 25 # , the inclination angle 
<f> of the side wall 21 S was 26 = 50° and the 
transparencies of the micro HM and the half-trans- 

25 parent mirror array 20 on the side wall 21 S were 
30% and 70%, respectively, the brightness on the 
display surface measured through the half-transpar- 
ent mirror array 20 was 50% higher than in the 
case where the inclination angle 4> of the side wall 

30 surface 21 S was zero. 

Thus, the spacing d of the micro HMs 21 has a 
dual effect of preventing ghost images while at the 
same time enhancing the brightness of a displayed 
image as referred to previously. 

35 Incidentally, the spacing d in Fig. 5 is deter- 
mined in relation to the width W and inclination 6 of 
each micro HM 21 , but since there are possibilities, 
in practice, that various ghosts are formed not only 
by incident light beams parallel to the optical axis 

ao Ox but also by light beams of various incident 
angles, it is necessary to experimentally determine 
the optimum spacing d which minimizes the forma- 
tion of ghosts in the video camera. Also in the case 
of the half-transparent mirror array 20 shown in Fig. 

45 4, the formation of ghosts can be reduced by 
suitably spacing the micro HMs 21 apart but the 
optimum value of the spacing d is not necessarily 
equal to the optimum value in the case of Fig. 5. 
Four samples of the half-transparent mirror ar- 

50 ray 20 shown in Fig. 5 were fabricated, in which 
the angles 6 were all 25' and the angles <t> were 
0*. 10*, 30' and 50°, respectively. Figs. 16A, 
16B, 16C and 16D are graphs showing the relation- 
ships between the angular positions where directly 

55 reflected light by the half-transparent mirror arrays 
20 and other reflected images (hereinafter referred 
to as ghosts) appeared and the intensity of the 
reflected light when light from a point light source 
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was applied to the half-transparent mirror arrays 
20. The abscissa represents the reflection angle 
position where images were detected and the or- 
dinate the intensity of the detected light. The inten- 
sity of the directly reflected light is indicated by a 
black-painted bar and the ghosts are indicated by 
hatched bars. Fig. 16A shows the case of <f> = 0, 
from which it is seen that a ghost of relatively high 
intensity appears in close proximity to the directly 
reflected image. The angular position and intensity 
of the ghost are different for different angles as 
shown in Figs. 16B to 16D. Thus, the optimum 
value of the angle 4> is determined by experiments 
so that the ghost is formed outside the image- 
capturing visual field or its intensity is below a 
given level. When the angle 6 is 25 c , the angle <f> 
may preferably be greater than 30 \ as seen from 
Figs. 16Ato16D. 

The occurrence of the ghost is attributable 
partly to the reflection of light, in particular, total 
reflection, by the back of the substrate 22 of the 
half-transparent mirror array 20, as depicted in Fig. 
15. In view of this, as shown in Fig. 17, an an- 
tireflection layer 22B may be formed all over the 
back of the substrate 22 to decrease the reflectivity 
thereon in the half-transparent mirror arrays 20 for 
use in the embodiments of Figs. 3, 10, 11 and 13. 
By forming the anti reflection layer 22B in a mul- 
tilayer structure, the reflectivity can be decreased 
over the entire wavelength range of visible light - 
this affords substantial reduction of the intensity of 
light reflected by the back of the transparent sub- 
strate 22. As a result, the brightness of a ghost 
which is caused by the reflected image from the 
back of the transparent substrate 22 and appears in 
the display surface 1A can be lowered, and con- 
sequently, the image quality on the display surface 
1Acan be improved. 

Fig. 18 illustrates in section another example of 
the half-transparent mirror array 20 adapted to de- 
crease ghosts attributable to the reflection on the 
back of the half-transparent mirror array 20. In this 
example the antireflection layer 22B in Fig. 17 is 
replaced with a layer 22C which disperses incident 
light and which is also formed all over the back of 
the transparent substrate 22. The incident light 
dispersing layer 22C is provided by, for example, 
forming fine irregularities over the entire area of the 
back of the transparent substrate 22, by which light 
is dispersed or prevented from reflection to a spe- 
cific direction. In consequent, it is possible to com- 
pletely remove from the display surface 1A the 
ghost which is caused by the reflection from the 
back of the half-transparent mirror array 20. Fur- 
ther, the user of the display and image capture 
apparatus according to the present invention, which 
employs the half-transparent mirror array 20 pro- 
vided with such an incident light dispersing layer 



22C, watches the display surface 1A through the 
light dispersing layer 22C, serious deterioration of 
the image quality on the display surface 1A can be 
prevented by placing the half-transparent mirror 

5 array 20 in close proximity to the display surface 
1A, because the half-transparent mirror array 20 
can be fabricated in the form of a relatively thin 
sheet as is the case with a plastic Fresnel lens. 
There is a case where a liquid crystal display, 

to which is a flat panel display, is used as the display 
1 so as to reduce the size of the display and image 
capture apparatus, but the liquid crystal display has 
the defect of a small angle of visual field. The light 
dispersing layer 22C formed in the back of the half- 

75 transparent mirror array 20 also produces an effect 
of increasing the angle of field of the liquid crystal 
display, since an image displayed thereon is dis- 
persed over a wide area. 

The foregoing description has been given of 

20 the case where light from the subject (the caller) M 
and light from its background form a ghost, but in 
the apparatuses shown in Figs. 3, 10 and 11 light 
from the image displayed on the display 1 is in- 
cident on the video camera 3 through the half- 

25 transparent mirror array 20, by which the displayed 
image can be captured while being superimposed 
on the directly reflected image. 

Fig. 19 is a photograph showing that a ghost 
image of the display surface, besides the directly 

30 reflected image, is present in a captured image in 
the display and image capture apparatus depicted 
in Fig. 3. The photograph was taken when captur- 
ing a reflected image from the half-transparent mir- 
ror array 20 placed in close contact with the dis- 

35 play surface of a liquid crystal display used as the 
display 1, the entire area of the display surface 
being held at the maximum display brightness lev- 
el. The subject M used is a thick crossshaped test 
chart. As will be seen from Fig. 19, there is a 

40 whitish area of lowered contrast in the center lower 
portion of the photograph - this indicates that the 
light from the display reached the video camera 3. 

Fig. 20 schematically illustrates an embodiment 
of the display and image capture apparatus config- 

45 ured to prevent the formation of the above-men- 
tioned displayed image in the captured image. In 
this embodiment a polarizer 16 is interposed be- 
tween the display surface 1A and the half-transpar- 
ent mirror array 20 and another polarizer 17 is 

so disposed in front of the video camera 3 so that its 
direction of polarization perpendicularly intersects 
that of the polarizer 16. Light from an image dis- 
played on the display surface 1A is linearly po- 
larized by the polarizer 16 and is emitted therefrom 

55 through the half-transparent mirror array 20, and 
hence the caller M can observe the image being 
displayed. Yet the linearly polarized light is inter- 
cepted by the polarizer 17, and hence is not in- 
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cident on the video camera 3. In this instance, 
however, the brightness of the image viewed from 
the caller M and the quantity of light incident on 
the video camera 3 from the subject M both de- 
crease. 

Rg. 21 shows the case of employing a trans- 
mission type liquid crystal display as the display 1. 
Since the liquid crystal display has polarizers 
mounted on the front and back of its liquid crystal 
panel in close contact therewith, the same effect as 
mentioned above is obtainable simply by dispos- 
ing, in front of the video camera 3, the polarizer 17 
having its direction of polarization perpendicularly 
intersecting that of the polarizer mounted on the 
front of the liquid crystal panel. In this case, the 
brightness of the display surface 1A does not di- 
minish. Since the liquid crystal display itself is 
small in depth, the combined use of the liquid 
crystal display and the polarizer 17 as shown in 
Fig. 21 also serves the purpose of forming a dis- 
play and image capture apparatus of a small depth. 

Fig. 22 schematically illustrates another em- 
bodiment of the display and image capture appara- 
tus intended to prevent the formation of the ghost 
image of the display image in the image captured 
by the video camera 3. In this embodiment a plate 
14 which has visual field selectivity is interposed 
between the half-transparent mirror array 20 and 
the display surface 1A. The visual field selective 
plate 14 is commercially available under the trade 
name "Angle 21" fabricated by Nihon Ita Garasu 
K.K., for instance. The visual field selective plate 14 
is opaque to the eye which forms an angle smaller 
than a predetermined value to the plate surface 
and is transparent to the eye of larger angles. For 
instance, when the visual field selective plate 14 is 
viewed from its front, an area within a certain visual 
field about the line of sight perpendicular to the 
plate is transparent and the other areas are all 
opaque. 

In the apparatus of Fig. 22 light from the dis- 
played image is not incident on the video camera 
3, since the camera 3 is placed in the direction of 
the line of sight in which the visual field selective 
plate 14 looks opaque. On the other hand, the 
caller M stands in front of the visual field selective 
plate 14, and hence is allowed to see the displayed 
image. More specifically, when the above-men- 
tioned plate known under the name "Angle 21" is 
used as the visual field selective plate 14, the 
viewing direction in which the plate 1 4 looks opaq- 
ue is in the range of from 30 to 60 degrees with 
respect to the normal (i.e. the optical axis) Ox to 
the half-transparent mirror array 20, so that the 
video camera 3 can be placed in the above-said 
opaque viewing direction by setting the inclination 
angle $ of the micro HMs 21 of the half-transparent 
mirror array 20 to a value within the range of 20 to 



25 degrees. Incidentally, the half-transparent mirror 
array 20 may also be formed integrally with the 
visual field selective plate 14 on the surface there- 
of, using the plate 14 as the substrate 22. 

5 Although the embodiments of Figs. 20, 21 and 
22 have been described to optically intercept the 
light directed toward the video camera 3 from the 
display surface 1A, the light may also be blocked 
electrically as described below. Rg. 23 schemati- 

70 cally illustrates a first embodiment intended to 
block the light electrically. As is the case of the 
Rg. 3 embodiment, the display 1, the half-transpar- 
ent mirror array 20 and the video camera 3 are 
provided, besides a control circuit 5 is provided 

75 which is connected to the display 1 and the video 
camera 3. The control circuit 5 is to control the 
display operation of the display 1 and the image- 
capturing operation of the video camera 3 in asso- 
ciation with each other. Fig. 24 shows the operation 

20 of the control circuit 5. The control circuit 5 repeats 
holding the display 1 in the OFF state for a first 
period Tt and in the ON state for a second period 
T 2 while at the same time controlling the video 
camera 3 to be ON only for a period To in each 

25 period Tl Thus no display image will be formed 
during the image capturing operation. In the case 
of employing, as the display 1, a liquid crystal 
display made up of a liquid crystal panel 10A and a 
back light 10B as depicted in Fig. 25, the above- 

30 mentioned control operation is performed by turn- 
ing ON and OFF a lighting switch SW of the back 
light 10B under control of the control circuit 5. The 
liquid crystal panel 10A is always driven by apply- 
ing thereto a voltage from a liquid crystal driver 

35 (not shown). In the first period Ti including the 
image capturing period T 0 the switch SW is in the 
OFF state to hold the back light 10B OFF and 
hence blacken a display image on the liquid crystal 
display 1. In the second period T2 for display no 

40 image capturing operation takes place and the 
switch SW is turned ON to light the back light 10B, 
providing a display on the liquid crystal display 1. 

Thus, in this embodiment a voltage is always 
applied to the liquid crystal panel 10A to hold it in 

45 an active state and the control circuit 5 controls the 
driving of the video camera 3 and the back light 
10B to selectively perform the image capturing 
operation and the display operation. 

Fig. 26 schematically illustrates another em- 

50 bodiment of the display and image capture appara- 
tus which effects the ON-OFF control of the display 
operation by the control circuit 5. This embodiment 
is identical with the Rg. 24 embodiment in the use 
of the liquid crystal display 1 composed of the 

55 liquid crystal panel 10A and the back light 10B but 
differs therefrom in the method of controlling the 
image capturing operation and the display opera- 
tion, in this embodiment the back light 10B is held 
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ON at all times. In the first period Ti including the 
image capturing period To the image capturing 
operation takes place while holding the display on 
the liquid crystal display 1 black by maintaining the 
driving voltage thereto at a black display level or 5 
inputting thereto data for the black display. In the 
second period T2 the display operation is carried 
out with the driving voltage of the liquid crystal 
drive 10C held at a normal display level. 

As mentioned above, in this embodiment the 70 
back light 10B is always lighted while at the same 
time the image capturing operation and the display 
operation are selectively performed by driving the 
video camera 3 and the liquid crystal panel 10A 
under control of the control circuit 5. 75 

Fig. 27 schematically illustrates another em- 
bodiment of the display and image capture appara- 
tus of the type involving the ON-OFF control of the 
display operation. This embodiment is identical 
with the embodiments of Figs. 25 and 26 in the use 20 
of the liquid crystal display 1 but differs therefrom 
in that a shutter 10D is interposed between the 
liquid crystal panel 10A and the back light 10B 
forming the liquid crystal display 1. The shutter 
10D may be formed by a liquid crystal panel which 25 
can be controlled, by ON-OFF control of a voltage 
or current applied thereto, to permit the passage 
therethrough of light and inhibit the passage there- 
through of light or absorb light. Alternately, a me- 
chanical shutter may also be used. The shutter 30 
10D is placed under control of the control circuit 5. 

With such an arrangement, the liquid crystal 
panel 10A is always driven, and in the first period 
T1 including the image capturing period T 0 the 
image capturing operation takes place while hold- 35 
ing the display on the liquid crystal display 1 black 
by blocking the light from the back light 10B with 
the shutter 10D being closed, whereas in the sec- 
ond period T2 the display operation takes place 
while holding the shutter 10D open to permit the 40 
passage therethrough of the light from the back 
light 10B. In this instance, the back light 10B may 
be continuously driven or controlled to turn ON and 
OFF as in the embodiment of Fig. 25. The video 
camera 3, the back light 10B and the shutter 10D 45 
are placed under control of the control circuit 5. 

Fig. 28 schematically illustrates still another 
embodiment, which employs, as the display 1, an 
emissive display such as an EL display, plasma 
display, or CRT. Since the display 1 is emissive, 50 
this embodiment does not call for the back light 
10B needed in the embodiments described above 
in respect of Rgs. 25, 26 and 27. In the first period 
Ti including the image capturing period T 0 the 
image capturing operation is performed while hold- 55 
ing the display image on the emissive display 1 
black by maintaining OFF the voltage of the driver 
10C for driving the emission display 1 or inputting 



thereto data for the black display. In the second 
period T2 the drive voltage is applied via the driver 
10C to the display 1 to provide thereon a display. 

In this case, it is also possible to utilize an 
arrangement in which the shutter 10D used in the 
Fig. 27 embodiment is placed in front of the emis- 
sive display 1 , the display 1 is always held active 
and the shutter 10D is driven ON and OFF to 
switch ON and OFF the display image provided on 
the emissive display 1 . 

While in Figs. 23 and 25 to 28 the video 
camera 3 is positioned diagonally above the dis- 
play 1, it is needless to say that the video camera 
3 may be placed diagonally below the display 1 or 
diagonally to the left or right of the display 1, by 
selecting the rotational angular position of the half- 
transparent mirror array 20. Various circuits or CPU 
can be used as the control circuit 5. 

The foregoing embodiments have been de- 
scribed to use the half-transparent mirror array 20 
which reflects an incident light image to one direc- 
tion (toward the video camera 3) by the array of the 
micro HMs 21 each inclined at the angle Q. In the 
case of employing such a half-transparent mirror 
array 20 as shown in Fig. 5, however, light incident 
on the side wall surface 21 S with no mirror formed 
thereon is partly reflected to a direction which is 
dependent on the inclination angle 4> and different 
from the direction toward the video camera 3, and 
consequently, the utilization efficiency of light is 
impaired accordingly. Now, a description will be 
given of an embodiment in which each inclined 
side wall surface 21 S also has a micro HM and an 
image by light reflected therefrom is captured by 
another video camera so that two image signals are 
effectively utilized. 

Fig. 29 is a sectional view showing the half- 
transparent mirror array 20 which is used for the 
above-mentioned purpose. There are formed micro 
HMs 21 1 and 21 2 on two slopes of each of the 
ridges 21 W formed in parallel on one side of the 
transparent substrate 22. The inclination angles 61 
and 62 of the micro HMs 21 1 and 212 may be 
equal to or different from each other and are prop- 
erly selected such that no ghost images will be 
formed as referred to previously. 

Fig. 30 schematically illustrates the configura- 
tion of the display and image capture apparatus 
according to the present invention which employs 
the half-transparent mirror array 20 depicted in Fig. 
29. In this example the image of the subject M is 
reflected upward and downward by the half-trans- 
parent mirror array 20 and the reflected images are 
captured by video cameras 3i and 32 disposed 
above and below the display 1. An image proces- 
sor 19 performs processing for superimposing vid- 
eo signals of the images captured by the video 
cameras 3i and 3 2 . The resulting video signal has 
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an amplitude substantially twice that obtainable 
with the use of one video camera, and conse- 
quently, the brightness of the display image can be 
increased accordingly. 

While in the Fig. 30 embodiment the incident 
light is reflected upward and downward, it may also 
be reflected to right and left. Fig. 31 is a plan view 
showing the configuration for reflecting the incident 
light to right and left. As shown, the rotational 
angular position of the half-transparent mirror array 
20 is determined so that the ridges 21 W extend in 
the vertical direction. Consequently, the incident 
light is reflected to right and left by the vertically 
extending micro HMs 21 1 and 21 2 . The video cam- 
era 3 receives the reflected rays of light to capture 
the image of the caller M. The two video signals 
thus obtained are superimposed by the image pro- 
cessor 19 to thereby provide an increased am- 
plitude. 

High resolution can also be achieved by syn- 
thesizing or combining the two captured image 
signals in the embodiments of Figs. 30 and 31 . For 
example, by superimposing images Pi and P2 cap- 
tured by the video cameras 3i and 32 as depicted 
in Fig. 32, an image P3 can be displayed with 
apparently two-fold resolution in the vertical or hori- 
zontal direction. 

In the embodiments of Figs. 30 and 31 the 
image of the subject M is reflected in two direc- 
tions, but the image can be reflected in more 
directions by designing the structure of the micro 
HM. Fig. 33 is a front view showing a part of the 
half-transparent mirror array 20, which has 
quadrangular pyramidal projections arranged in a 
matrix form on one side of the transparent sub- 
strate 22 and has micro HMs 21 1 to 2U formed on 
four slopes of each pyramidal projection. With such 
a structure, incident light can be reflected by the 
micro HMs 21 1 to 21 4 in four directions. This 
further enhances the quality of the captured image 
as compared with that obtainable with the structure 
of the Fig. 20 embodiment. Needless to say, four 
video cameras are used in this case. 

Fig. 34 schematically illustrates a modified 
form of the Fig. 31 embodiment, in which the two 
video signals available from the left and right video 
cameras 3i and 32 are not combined as in Fig. 31 
but instead they are multiplexed by a multiplexer 
29 and then transmitted to the remote station, 
where the transmitted signal can be demultiplexed 
into two video signals for 3D display use. Since the 
image of the subject M is reflected by the half- 
transparent mirror array 20 to right and left, image 
data for 3D display can be obtained through utiliza- 
tion of the parallax between the reflected images. 
In the case of capturing the image of the subject M 
directly by video cameras disposed on the right 
and left of a 3D display V as indicated by the two- 



dot chain lines, without employing the half-transpar- 
ent mirror array 20, an angle of parallax (an angle 
at which the subject M is viewed from the two 
video cameras along their optical axes) B increases 

5 with an increase in the size of the display surface 
of the 3D display V. On this account, the depth 
effect by parallax is so much emphasized that 
images for right and left eyes are not easily com- 
bined into one 3D image in the brain, resulting in 

10 fatigue of the brain. With the use of such a half- 
transparent mirror array 20 as proposed by the 
present invention, it is possible to arbitrarily posi- 
tion the video cameras 3t and 3 2 and set their 
optical axes Oxi and OX2, permitting image captur- 

T5 ing at an appropriate angle of parallax 5 and hence 
overcoming the above-noted defect. This makes it 
possible to offer a display and image capture ap- 
paratus which enables eye contact and provides a 
display full of a sense of reality. 

20 By using a lenticular sheet in the 3D display V 
and coating a half-transparent mirror on the surface 
of each lenticular lens it is possible to offer a 
smaller and less costly display and image capture 
apparatus for 3D display, because the lenticular 

25 sheet serves also as the half-transparent mirror 
array 20 depicted in Fig. 34. 

In the embodiments described above, since the 
half-transparent mirror array formed an array of 
micro HMs is disposed in front of the display 1, the 

30 brightness of the displayed image thereon is inevi- 
tably lowered. Such deterioration of the picture 
quality could be held down by a combination of a 
display of a specific structure and a half-transpar- 
ent mirror array of a specific structure as described 

35 below. 

Fig. 35 is a schematic diagram for explaining 
the construction of one micro HM 21 of the half- 
transparent mirror array 20 for use in the display 
and image capture apparatus of the present inven- 

40 tion and its principle of operation. The display 1 
comprises the liquid crystal panel 10A, a polarizer 
10P disposed behind it and the back light 10B. The 
micro HM 21 is formed by a polarizing beam 
splitter (hereinafter referred to as a PBS). In Fig. 35 

45 the angle d is the angle of inclination of the reflect- 
ing surface 21 R in the PBS. 

The reflecting surface 21 R is formed by a 
dielectric multi-layer and light from the subject M 
standing in front of the PBS 21 is incident thereon 

50 but only S-polarized light is reflected by the reflec- 
tion surface 21 R. The reflected light image, cap- 
tured by the video camera 3, is equivalent to an 
image captured at the position of the display 1. 
The PBS 21 permits the passage therethrough of 

55 only P-polarized light and hence functions as a 
polarizer and is used also as a polarizer for the 
liquid crystal display. 

In the display and image capture apparatus 
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which employs a liquid crystal display of the type 
having a polarizer formed on its front, the quantity 
of light transmitted therethrough is reduced by the 
polarizer down to about 30% and is further reduced 
by the half-transparent mirror down to around 50%, 
resulting In the brightness on the display surface 
being lowered. In the apparatus of Fig. 35, how- 
ever, since the PBS 21 serves both as the half- 
transparent mirror and as the polarizer, it is possi- 
ble to check a decrease in the quantity of light 
transmitted and hence prevent a decrease in the 
brightness on the display surface. 

Fig. 36 schematically shows the general con- 
figuration of a display and image capture apparatus 
in which a plurality of such micro PBSs 21 as 
mentioned above are arranged in the same plane 
to form the half-transparent mirror array 20, which 
is used also as the polarizer of the liquid crystal 
display and is disposed in front of the liquid crystal 
10A The liquid crystal display 10A is irradiated by 
light from the back light 10B through the polarizer 
10P placed behind the liquid crystal panel 10A. As 
compared with the configuration employing a CRT 
as the display 1, the configuration of this embodi- 
ment affords substantial reduction of the depth d, 
and hence permits miniaturization of the apparatus. 

Fig. 37 illustrates in section the half-transparent 
mirror array 20 and the liquid crystal panel 10A of 
a display and image capture apparatus which uti- 
lizes the half-transparent mirror array 20 formed by 
arranging the micro PBSs 21 and a color liquid 
crystal display. Also in this case, the half-transpar- 
ent mirror array 20 is used as a polarizer forming 
part of the liquid crystal display. The micro PBSs 
21 each permit the passage therethrough of one of 
red light, green light and blue light. 

An ordinary liquid crystal panel for color dis- 
play decomposes white light, by color filters, Into 
wavelengths corresponding to red light, green light 
and blue light and provides a color display by 
controlling the transmittivity of each light. In this 
instance, the dielectric multi-layer film coated over 
the reflecting surface 21 R of the PBS transmits the 
P-polarized light but reflects the S-polarized light. 
By properly selecting the thickness and the refrac- 
tive index of the multi-layer inductor film, the trans- 
mission and reflection of light can be made 
wavelength-dependent; namely, a desired interfer- 
ence color can be attained. In the liquid crystal 
display for use in the display and image capture 
apparatus of this embodiment micro PBSs 21 , each 
of which permits the passage therethrough of only 
red light, green light or blue light, are disposed 
opposite pixel electrodes 10E each forming one 
pixel, and consequently, the micro PBSs 21 func- 
tion both as the polarizer and as the color filter. 

The configuration of this embodiment does not 
call for the use of a color filter, and hence substan- 



tially improves the brightness on the display sur- 
face. 

Figs. 38A and 38B are a plan and a sectional 
view illustrating another example of the half-trans- 

5 parent mirror array 20 for use in the display and 
image capture apparatus of the present invention. 
The micro HM films 21 and transparent films 22 
are arranged alternately with each other at a certain 
angle $ to the surface of the array 20. A portion 

70 surrounded by the dotted line in Fig. 38B serves as 
a micro beam splitter and one portion of light 
incident on this optical element passes intact there- 
through and the other remaining portion of the 
incident light is reflected in the direction of a cer- 

75 tain angle ^ shown in Fig. 38B. 

Next, a description will be given, with reference 
to Figs. 39A through 39C, of a method for the 
fabrication of the half-transparent mirror array 20 
shown in Figs. 38A and 38B. The fabrication starts 

20 with making a number of half-transparent mirror 
sheets each formed by coating the micro HM film 
21 on a transparent substrate 22 such as a highly 
flat sheet of glass, as shown in Fig. 39A, followed 
by laminating and bonding the half-transparent mir- 

25 ror sheets to form a laminated structure such as 
depicted in Fig. 39B. Next, the laminated structure 
thus obtained is cut at the angle 6 to the surface 
thereof into a desired thickness t as shown in Fig. 
39C and then the cut ends of the cut-out member 

30 are polished. Thus, the half-transparent mirror array 

20 shown in Figs. 38A and 38B is obtained. 
While in the above a number of transparent 

substrates 22 each coated with the micro HM film 

21 are laminated, it is also possible to fabricate the 
35 laminated structure shown in Fig. 38B, by deposit- 
ing the micro HM films 21 and the transparent films 

22 alternately with each other on the transparent 
substrate as of glass. The thicknesses of the re- 
spective layers of the laminated structure, the cut- 

40 ting angle e and the thickness t are free from any 
specific limitations and can freely be chosen. The 
manufacturing method mentioned above is advan- 
tageous in that the flatness, size and inclination 
angle of the reflecting surface are highly accurate, 

45 since substrates of excellent flatness are used. 
Accordingly, the use of the half-transparent mirror 
array produced by such a method precludes the 
possibility of defocusing of a reflected image which 
is caused by scattering of the inclination angle of 

50 the reflecting surface or its poor flatness or un- 
evenness, and hence ensures capturing an image 
of good quality by the video camera 3. 

The micro HM film 21 may be formed of chro- 
mium, aluminum or similar metal, or an inductor. 

55 By using, as the HM film 21, a multi-layer film 
formed by dielectric materials of different refractive 
indexes, it is possible to obtain the function of a 
dichroic mirror or a polarizing beam splitter. In this 
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instance, the half-transparent mirror array 20 
serves as a half-transparent mirror having a func- 
tion of controlling the transmission and reflection of 
incident light according to its state of polarization 
(i.e. functions as a polarizing beam splitter PBS) 
and reflects only S-polarized light of the light from 
the subject standing in front of the PBS. The re- 
flected light image captured by the video camera 3 
is equivalent to an image captured from the posi- 
tion of the display 1. Further, the PBS permits the 
passage therethrough of only the P-polarized light, 
and hence possesses the function of a kind of 
polarizer. 

As described above, the apparatus of the 
present invention has a construction in which the 
half-transparent mirror array formed by micro HMs 
arranged in the same plane at a desired inclination 
angle is disposed opposite the display surface of 
the display and a reflected image from the half- 
transparent mirror array is captured by the video 
camera, and hence the depth of the apparatus is 
small. 

Besides, since a reflected image from the 
micro HM film 21 is captured, the image is inverted 
laterally, but it is self-evident that this problem can 
be solved by the use of a display capable of 
displaying the image after inverting it again by 
electrical processing of the video signal, or by 
reflecting the reflected image again. Moreover, by 
turning the half-transparent mirror array 20 a de- 
sired angle in the same plane so that the micro 
HMs 21 are directed in a desired direction, the 
video camera 3 can be positioned below or above 
the display 1 or on the right or left thereof. 

It is apparent that many modifications and vari- 
ations may be effected without departing from the 
scope of the novel concepts of the present inven- 
tion. 

Claims 

1. A display and image capture apparatus com- 
prising: 

display means provided with a display sur- 
face for displaying an image; 

half-transparent mirror means disposed 
substantially opposite the front of said display 
surface substantially in parallel thereto, for re- 
flecting a portion of light from a subject stand- 
ing in front of said display surface and for 
transmitting therethrough a portion of light from 
said image on said display surface, said half- 
transparent mirror means including a plurality 
of micro HMs arranged in the same plane at 
predetermined inclination angles 0, respective- 
ly, for reflecting a portion of light from said 
subject; and 

image capturing means disposed near said 



display means, for receiving light reflected 
from said half-transparent mirror means and for 
capturing the image of said subject. 

5 2. The apparatus of claim 1 wherein said inclina- 
tion angles 0 of said micro HMs are selected in 
the range of between 13 and 45 degrees. 

3. The apparatus of claim 1 wherein said image 
jo capturing means includes distortion correcting 
optical means which receives reflected light 
from said half-transparent mirror means and 
enlarges or reduces said reflected light in such 
a direction as to correct a distortion of a re- 
75 fleeted image caused by said half-transparent 
mirror means, and a video camera for captur- 
ing the corrected reflected image from said 
distortion correcting optical means. 

20 4. The apparatus of claim 3 wherein said distor- 
tion correcting optical means includes a curved 
mirror disposed outside of said display surface 
and in front of said half-transparent mirror 
means. 

25 

5. The apparatus of claim 1 wherein said image 
capturing means includes a video camera dis- 
posed near said display means and directed 
forwardly thereof, and reflecting mirror means 

30 disposed outside of the outer periphery of said 
display surface and directed forwardly of said 
image capturing means, for receiving reflected 
light from said half-transparent mirror means 
and for reflecting it toward said image captur- 

35 ing means. 

6. The apparatus of claim 2 wherein, letting the 
width of each of said micro HMs being repre- 
sented by W, said micro HMs are spaced 

40 about WsinflMan20 or more apart. 

7. The apparatus of claim 1 wherein said display 
means includes first polarizing means for lin- 
early polarizing light from said display image 

45 and said image capturing means includes sec- 
ond polarizing means disposed in front thereof 
for blocking polarized light from said display 
means. 

so 8. The apparatus of claim 7 wherein said display 
means is a transmission type liquid crystal 
display. 

9. The apparatus of claim 1 wherein said display 
55 means includes a visual field selective trans- 
parent plate interposed between said display 
surface and said half-transparent mirror means, 
said visual field selective transparent plate be- 
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ing opaque at a visual angle at which to view 
said image capturing means. 

10. The apparatus of claim 9 wherein said half- 
transparent is formed integrally with said visual 5 
field selective transparent plate on one side 
thereof. 

11. The apparatus of claim 1 further comprising 
control circuit means whereby said display w 
means is held in the OFF state for a predeter- 
mined first period at fixed time intervals and 

said image capturing means is turned ON in 
each of said first periods. 

75 

12. The apparatus of claim 1 wherein said half- 
transparent mirror means includes an anti- 
reflection layer formed on the back thereof. 

1a The apparatus of claim 1 wherein said half- 20 
transparent mirror means includes a light dis- 
persing layer formed on the back thereof. 

14. The apparatus of claim 1 wherein said half- 
transparent mirror means includes a transpar- 25 
ent substrate, a plurality of projections formed 
integrally with said transparent substrate on 

one side thereof and each having a plurality of 
slopes, and said micro HMs each formed on at 
least one of said slopes of said projections. 30 

15. The apparatus of claim 14 wherein gaps be- 
tween said projections formed on said trans- 
parent substrate are filled with transparent res- 
in so that the surface of said transparent sub- 35 
strata is substantially flat. 

16. The apparatus of claim 14 wherein said micro 
HMs are formed on all of said slopes of said 
projections and said image capturing means 40 
includes a plurality of video cameras disposed 
apart around said display means, for receiving 
reflected light from each of said slopes of said 
projections. 

45 

17. The apparatus of claim 1 wherein said image 
capturing means includes a plurality of video 
cameras disposed apart around said display 
means and said micro HMs arranged on said 
half-transparent mirror means are formed by 50 
different micro HMs whereby light incident 
thereto from said subject is reflected toward 

said plurality of video cameras. 

18. The apparatus of claim 1 wherein each of said 55 
micro HMs forming said half-transparent mirror 
means is formed by a polarization-dependent 
micro beam splitter which passes therethrough 



one polarized component of incident light and 
reflects a polarized component perpendicular 
to said one polarized component, wherein said 
display means is a liquid crystal display and 
includes back light means, a first polarizing 
plate for linearly polarizing back light from said 
back light means and a liquid crystal panel to 
. which said back light through said first polariz- 
ing plate, and wherein said half-transparent 
mirror means formed by said micro beam split- 
ters is disposed in front of said liquid crystal 
panel and serves also as a second polarizing 
plate of said liquid crystal display. 

19. The apparatus of claim 18 wherein each of 
said micro beam splitters forming said half- 
transparent mirror means possesses a 
wavelength dependence for the reflection and 
transmission of incident light thereto so that it 
constitutes a color filter for said liquid crystal 
display. 

20. The apparatus of claim 1 wherein said half- 
transparent mirror means has a laminated 
structure formed by laminating transparent lay- 
ers and half-transparent layers alternately with 
each other and having, as the front and back of 
said half-transparent mirror means, two parallel 
faces cut at said inclination angles to said 
laminated layers. 

21. The apparatus of claim 20 wherein said half- 
transparent layers are metal layers. 

22. The apparatus of claim 20 wherein said half- 
transparent layers are each dielectric layer of a 
refractive index different from that of said 
transparent layers. 

23. The apparatus of claim 20 wherein said half- 
transparent layers are each formed by a plural- 
ity of laminated dielectric layers of different 
refractive indexes. 

24. The apparatus of claim 1 wherein the transpar- 
ency of each of said micro HMs is 50% or 
less. 
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